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ABSTRACT 



The 1990 Sunaner Academic Skills Achievement Program 



in Columbus (Ohio) provided 160 hours cf instruction in reading 
comprehension and language meur.anj.cs skills needed for entry-level 
employment to 123 Job Training Partnership Act (JTPA) clients. The 
program used a "whole language" approach to grammar and composition 
instruction and also included instruction in preemployment skills. 
Five evaluation criteria were developed based on student pre- and 
post-program performance on the Comprehensive Test of Basic Skills 
(CBTS) and on class attendance. Th'* program failed to meet four of 
the five objectives^ Results indie ace that: (1) clients who attended 
75 psrcent of the program failed to demonstrate a gain of at least 
one grade equivalent from pretest to posttest; (2) clients who 
attended 75 percent of the program did not improve objective-level 
nastery by 30 percent from pretest to posttest; (3) 80 percent of the 
clients who attended 75 percent of the program failed to score 70 
percent or higher on the posttest; and (4) 90 percent of the clients 
who entered the program did not attend at least 75 percent of the 
program. Clients who attended 75 percent of the program did appear to 
show greater improvement from pretest to posttest, satisfying the 
fifth objective, but lack of posttest data prevented statistical 
analysis. Recommendations for improvement include ir proving the 
retention of black male clients and recruiting more non-minority 
clients. Thirty-one tables of statistical data are appended. (FMV;) 
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FINAL EVALUATION REPORT 
SU^^MER ACADEMIC SKILLS ENHANCEMENT PROGRAM 

1990 

Abstract 



Program Description : The Summer Academic Skills Achievement Program was funded 
by the Private Industry Council (PIC) of Franklin County through the Job 
Training Partnership Act (JTPA)» The purpose of the program was to provide 
JTPA clients with the reading comprehension and language mechanics skills 
required for employment into entry-level positions. A total of 160 curriculum 
hours were used toward this end. 

Three selection criteria were used to define program eligibility: (a) JTPA 
eligible and PIC referred; (b) enrolled in a Columbur. high school; and (c) 
demonstrated skill deficiency in reading, langupje, or mathematics* Clients 
accepted into the program used the Houghton-Mifflin New Directions in Reading 
curriculum, the Houghton-Mifflin "whole language" grammar and composition 
series, and the same publisher's mathematics curriculum Individualized 
Computational Skills Program and Essentials for High School Mathe-natics ♦ 

The 1990 program consisted of two segments: testing (May-June) and 
remediation (June-August). Performance objectives were stated for each of the 
two remediation foci: reading comprehension, language mechanics. 

In addition to the two academic curricula addressed, nre-employment skills 
also were taught to clients. Using the MPC Educational Publishers' booklet Job 
Seeker's Guide , these skills were stressed as an integral part of each academic 
curriculum; i.e., employment skills instruction took place at scheduled times 
each week, where the instructional topic for the week was mandatory. 

Project Evaluation Criteria* 

Comprehensive Tests of Basic Skills (CTBS): 

1. Clients who attend 75% of the program days will demonstrate a gain 
of at least one (I) grade equivalent from pretest to posttest in 
at least one of these areas: reading comprehension, language 
mechanics, mathematics computation . 

2. On average, clients who attend 75% of the progLam days will 
improve objective-levei mastery by 30% from pretest to posttesc 
across instructional objectives* in respective curricula. 

3» Contrasted to those who do not, clients who attend at least 75% of 
the program days will attain objective-level mastery at a 
statistically- significant point, pretest to posttest. 

Employment Skills (ES): 

!• Of clients who attend at least 75% of the program day,<; , 80% or 
more will score 70% or higher on the posttest* 
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Client Retention: 



1. At least 90% of the clients pretested into the program will attend 
75% cf the program days. 

Major Findings : One hunc'red twenty-three clients were enrolled into the 1990 
Summer Program and analysis of pretest answer sheets yielded the following 
median grade-equivalent values: reading comprehension 5.7; language mechanics 
4.5; mathematics computation 6.6. Following remediation, these median values 
were observed for 96 clients: reading comprehension 6.2 (+0.5); language 
mechanics 5.0 (+0.5); mathematics computation 6.7 (+0.1). 

A client who atteniled 75% of the available attendance days (30 days 
minimum) increased the number of instructional objectives mastered 
(pretest-posttest) by 5%. Eighty-three clients met this attendance criterion. 
On pretesting of the 16 instructional objectives, the average number mastered 
was 24%. After treatment and posttesting, the average was 29% mastered. Over 
the eight-week remediation interval, clients' mastery of the 16 instructional 
objectives increased from less than four to between five and :5ix. 

Analysis of 1990 data was directed toward the five Project Evaluation 
Criteria stated in the proposal. The first three criteria relate to 
achievement testing with the CTBS instrument. Criterion Four examines 
Employment Skills measurement at posttesting, and the fifth criterion addresses 
Client Retention. 



Criterion 



Summary 



1- 1.0 Grade 
Equivalent 
Increase 
(CTBS) 



Eighty-three clients attended 30 or more days of 
instruction. Of these, 48 (58%) gained at least 1.0 ^E on 
at least one of the three instructional areas. This level 
is comparable to that observed in 1989. The criterion that 
all pupils would show a gain of 1.0 on at least one measure 
was not achieved. 



ERLC 



2- Improve 
Mastery 
by 30% 
(CTBS) 



3- Attendance 
and Gain 
(CTBS) 



4- Post test 
Success 
(ES) 



In 1989, a 25% increase was measured; i.e., a gain of 
abo't four mastered objectives, pretest to posttest. The 
gain in 1990 was 5%, or perhaps one mastered objective. In 
part, the 1990 observation is due to the impact of 32 
clients who scored extremely low on the pretest. (This 
type of client was uncommon in the 1989 group.) These 
clients (all of whom met the 30-day-attendance criterion) 
mastered far fewer objectives at posttesting chen did other 
clients who also met the attendance criterion. The 
criterion of 30% gain in objective mastered was not 
achieved. 

Although the lack of posttest data for many of those who 
attended less than 30 days of instruction (27 clients of 40 
did not take the posttest) prevented statis-tical analysis 
as was planned, clients who attended 30 or more da^;s scored 
higher on posttesting than did those who attended less *:han 
30 days . 

Looking at clients who attended 30 or more days, 61 (73%) 
of Che 83 possible met Che 70% correcc cricerion. The 
cricerion thac 80% would score 70% or beccer was noc 
achieved. 



EVALSRVCS/P548/PICFRPT90 



4 



5- Client A total of 123 clients were pretested into either a Reading 

Retention Comprehension or Language Mechanics program. Of these, 83 
(67%) attended at least 30 days of instruction* The 
criterion that 90% would attend at least 30 days was not 
achieved* 

From pretest to posttest, 96 clients were retained (took both tests). 
Forty-three percent of the pretest group were female; 57% were male; 10% were 
non-minority; 83% were black. At posttest, male attendance (male/black 
particularly) decreased such that the percents by sex were about equal. 
Retention of male blacks is an issue to be addressed in 1991. 



Summary /Re commendations 

Projection of Evaluation Criteria for the 1991 Summer Program assessment 
should be tempered by an appreciation of the clientele likely to attend. Grade 
equivalent analysis is appropriate for a cross-section o'' learning 
abilities/leveis but mastery change may be misleading; e.g., a client can gain 
1.0 GE without reaching mastery of an instructional cDjective. 

Achievement gain in J 990 approximated that observed in 1989. But, certain 
areas tested with the CTBS suggest that additional emphsisis might be given to 
objectives shown to exhibit little gain. For example. Main Idea (Objective 3, 
Reading Comprehension) appears to be a target for immediate examination (change 
in percent mastered from pretest to posttest was 1%). Some objectives seem to 
be receiving more emphasis than are others (change was in double digits). 

Mastery, defined at the objective level as answering 75% of the available 
items per ob:ective, was evaluated for two groups: special education and 
others. Lowe^;t Pretest Achievement (LPA) students (N=32) demonstrated a net 
gain (posttest - pretest) of six objectives mastered. "Others" (N=51) had a 
net gain of b4 objectives mastered. It is clear that combining these two 
groups depressed the mastery-gain statistics reported for 1990. If LPA 
students are included in the 1991 Summer Program, revised evaluation criteria 
should be used. Overall, given the project clientele consideration should be 
given to judging the success of r.he program based on curricular objectives 
rather than objectives from a norm-referenced test. 

If the program is to serve its target group of all economically 
disadvantaged JTPA eligible clients, recruitment of non-minority clients should 
be a program priority in 1991. Only 12 such clients were pretested with the 
CTBS instrument in 1990. 

Correlation of demographic attendance, pretest and posttest data in 1990 
was possible because a system for student identification was implemented. This 
system worked and data analysis could be used to contrast groups based on the 
75% attendance criterion. These analyses are informative and the system should 
be retained for 1991 

Client retention is crucial for improved achievement. Specifically, 
male/black clients have nhe highest attrition rate observed. That is, after 
pretesting a greater percent of male/blacks will leave the program prior to 
posttesting than for any other group. Increased attention needs to be given to 
these clients. Keeping all clients for the program's duration must be a goal 
for 1991. 
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Private Industry Council of Franklin County 
Job Training Partnership Act 



FINAL EVALUATION REPGRT 
SUMMER ACADEMIC SKILLS ENHANCEMENT PROGRAM 

1990 

Program Description 

The 1990 Summer Program consisted of two distinct phases: testing and 
remediation. The testing phase was designed to identify youth eligible for the 
program; remediation strategies were adopted to maximize the potent.ial for 
improving clients ' content mas tery in two instructional areas : reading 
comprehension (six objectives); (b) language mechanics (five objectives). The 
proposed Description of Services statement summarized these two phases as 
"Diagnostic Testing" and "Remedial Academic Training*" Underlying the 
remediation phase was a singular goal: provide JTPA clients with the academic 
skills necessary for "employment into entry level positions." 

Pveferral and Selection 

The target group for this program was defined as "All economically 
disadvantaged JTPA eligible clients who have an interest in renedial/ 
Pre-Employment/work maturity training. 

Three criteria were used to establish client eligibility: 

1. JTPA-eligible and PIC referred; 

2. enrolled in a Columbus high school; and 

3. demonstrated skill deficiency in reading, language, or mathematics. 

The selection process was initiated by a referral from the Private Industry 
Council (PIC). Referrals were tested and the Columbus Public Schools" 
Department of Community Education notified PIC regarding measurements per 
criterion thr^e. PIC then indicated names to become clients. 

A maximum of 500 PIC- identif ied youth were to be pretested. Of these, a 
maximum of 116 PIC-ref erred youth were to be selected to rittend the eiglit-week 
rer.iediation phase beginning in mid-June. Tlie remediation phase was conducted 
at the North Education Center and emphasized prescriptive/individualized 
instructional strategies and materials. 

Recruitment Methods : The Private Industry Council supplied (by way of the 
PIC -10 referral form) the Department of Community Education with the names of 
161 eligible youch who were chosen or self-identified for participation in the 
Summer Academic Skills Enhancement PrograiP ("Fast Track"). In April, the 
Department administered a CTBS battery to those youth. One hundred and 
twenty-three y^ ath were selected by PIC for the "Fast Track" program. The 
department also assisted PIC officials with orientation and enrollment. 
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Testi tg 

Comraencing May 15, 1990, Che Department of Community Education administered 
the Comprehensive Tests of Basic Skills (CTBS;19Cl), Form U, Level H reading 
comprehension, language mechanics, and mat^.srnatics computation subtests to 161 
PIC-identif ied youth. The principal assessment activity for students enrolled 
In the Columbus City School District took place at students" home schools. For 
youth livi.'g outside the Columbus City bchool District or for youth referred 
after the testing period was closed, testing was administered by PIC personnel 
at a site designated by PIC management. The Department of Community Education 
supplied PIC staff ^7ich the test instruments and answer sheets. 

The Department of Program Evaluation of the Columbus Public Schools scored 
completed tests and produced individual diagnostic L^-oorts and system 
summaries. All scores were norm- referenced. The Columbus evaluators used the 
TESTMATE microcomputer software system to scan, score, and report 
norm-referenced data. 

The Departnent of Community Education, in concert with the Department of 
Program Evaluation selected Form U, Level H of the Comprehensive Tests of Basic 
Skills (third edition) as the most appropriate level of difficulty for the 
identified client group. The CTBS is c. nom-ref erencecf achievement test, the 
content categories of which were defined by examining current state nd 
district cu'-ricalum guides, published texts and instructional programs, and 
criterion-r* f erenced assessment instruments. Columbus evaluation professionals 
selected the reading comprehension, language mechanics, and mathematics 
computation subtests for administration to clients. Total time for actual 
testing was ^3 minutes; test administration protocols added approximately 35 
minutes to the testing session. 

Reading . At the lowest levels, the reading comprenension test neasures visual 
and sound recognition of letters, words, vowels, and consonants. Items 
measuring comprehension skills are related to sentences and stories. Reading 
comprehension items measure skills in understanding sentence neaning, passage 
details, character analysis, main ideas, ^generalization, written forn.s, and 
author techniques. 

Language 'leclianics . These items neasr'-e the student's ability to identify the 
correct use of capital ■''=itters, perioas , commas, exclamation points, question 
marks, quotation marks, colons, semicolons in sentences And in extended 
passages . 

Mathematics . The mathematics computation items measure the operations of 
addition, subtraction, multiplication, and division of decir^als. Also, 
integers are cove*-ed. 

Testing Methodology Used . The tests' designers used a three-parameter Item 
Response Theory to scale the CTBS and to develop norms. Application of IRT 
methodology provides a number of direct benefits to the user of CTBS U, 
including more accurate descriptions of client performance. Consultants from 
the educational community, represented by native American, Asian, Hispanic, and 
Black ethnic and cultural groups, reviewed all items for possible racial, 
ethnic, .-nd gender bias. Consequently, the standardir,ed instruments do not 
contain items that appeared statistically biased in item tryouts. In the 
standardization, the sample reflects ethnic minorities as they are represented 
in the general population. 
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Remediation 

One hundred and twenty-three PIC-referred youth were enrollad in an 
eight-week summer prescriptive and individualized instructional program at the 
North Education Center as part of the Summer Youth Employment Training Program 
operated by the Private Industry Council. The instructional phase of the 
remedial program took place from June 18, 1990, until August 10, 1990, Those 
clients who successfully completed course work were eligible to receive 0,5 
unit of academic credit for reading, 0.5 unit of academic credit for language 
arts, or 0.5 unit of academic credit for mathematics computation. 

Clients attended da^ly classes in reading comprehension and language arts. 
Client instructional hours began at 8:10 a.m. and concluded at 11:50 a.m. 
Monday through Friday. (All training was delivered by instructors certificated 
by the State of Ohio.) 

At the conclusion of the summer instn-ctional phase, staff administered the 
CTBS (UH) to clients retained to that point. The Department of Program 
Evaluation analyzed data with appropriate statistical tests to deternine 
whether the j^rummer remedial treatment was effective in improving clients" basic 
academic skills. 

The Department of Community Education chose instructional materials based 
on research findings that have correlated student learning with patterns of 
curriculum organization. Specifically, researchers discovered that highly 
structured instructional formats are most effective when working on basic 
skills competencies with lower achieving students. The following curricula 
were designed to achieve maximum mastery over a short time through rigorous 
instructional organization : 

Reading Comprehension. The curriculum employed was Houghton-Mifflin's New 
Directions in Reading program, which has been designed as a reading 
comprehension achievement series for high schorl students who have not yet 
mastered reading comprehension skills. The three-part instructional plan 
consists of (a) preparation ii. vocabulary building, (b) en' incement of 
comprehension skills through guided reading, and (c) review and extension 
exercises to verify comprehension and provide skills reinforcement through 
immediate practice. The comprehension domain is the central focui of each 
instructional unit, and the curriculum stresses 10 comprehension skills: 
understanding punctuation, understanding word referents, using context to 
reveal word meanings, and to unders*:and figurative language, noting important 
details, understanding sequence of events, recognizing the main idea of 
paragraphs, making inferences and drawing conclusions or predicting outcomes, 
understanding cause-effect relationships, understanding comparisons, and 
distinguishing between fact and opinion. In addition to quizzes for individual 
lessons, instructors administered both mid-level and end-of-level testing. 

Language Mechanics. The language curriculum used Houghton-Mifflin's ''whole 
language" grammar and composition series. This curriculum integrates grammar 
with reading and writing skills. Grammar units begin with the presentation of 
the basic lesson, and from that base they progress to vocabulary building 
activities. These activities are capppd by exercises that assist students to 
make the crucial grammar-writing connection. Students then move to "checkup" 
activities that assess mastery levels attained. A cumulative review follows, 
which in turn is supplemented by enrichment work or differentiated additional 
practice (easy, average, or challenging). Reading and writ*.ng units commence 
with literature selections and are followed by activities that give students 

ER?C o 
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practice in using the three modalities of literature response: listening, 
speaking, and thinking (inferring/drawing conclusions). Composition skills are 
taught through the five-step writing process: pre-writing, drafting,, revising, 
proofreading, and publishing (final drafting). Students master spelling skills 
using Houghton-Mifflin's spelling program, which supports a complete testing 
program in standardized test format. 

Eraployment Skills 

The Department of Community Education also addressed the issue of improving 
clients' employment potential. Because many clients do not have the 
non-academic basic skills essential if one is to secure a position, instruction 
in this important area was continued in the 1990 Summer Program. The Job 
Seeker's Guide curriculum by MPC Educational Publishers was used. To be 
counted os a success for this program a client pretest score of less than 38 
and a posttest of 38 or more were required. 

Employment skills were taught as an in-egral part of both academic 
curricula: (5) reading comprehension and (b) language mechanics. So, no matter 
^'hich particilar academic curriculum a rlient entered, employment skills also 
were emphasized. The objective was to improve job readiness of clients by 
improving pre-employment skills. A segment of instructional time in each class 
vas alloted each week during which the instructor covered a specific 
employment-skills topic. These topics were covered during the remediation 
phase of the program: 

1. Deter'-ining Your Strengths 

2. Professional Devc-iopment and Your Personal Qualities 

3. Begin Your Job Search 

4. Your Social Security Card and Other Preparation 

5. Locating Job Possibilities 

How to Prepare Resumes and Application Forms 

7. Telephoning for an Interview 

8. Understanding Application Forms and Dealing with Problems 

9. Filling out Applicanion Forms 

10. Planning a Successful Interview 

11. Job Applicant Rating Form 

12. Performance and Success on the Job 

Evaluation Design 

Pretesting of program candidates was I'sed to discern *:;kills deficiencies 
and to constitute the final of three eligibility tests. Candidates who became 
program clients were then ^uided through the remecMation phac*^ g« described 
above. Clients who completed the eight-week instructional program were then 
posttested to reveal pre/posttest change with respect to reading comprehension, 
language mechanics, and mathematics computation observed scores. 

Be-rause the Summer 1989 Program evaluation design could not be implemented 
due to a student ID number problem, this year care was taken to standardize the 
number-assignment procesr, . The Department of Program Fvaluation (DPE) 
pre-printed CTBS answer forms and prepared lists of students who were pretested 
for use by the summer Program Coordinator. Summer 1990 projjram personnel used 
these lists to code student numbers on all forms returned to the DPE for 
analysis. Thus, it was possible this year to conduct dialysis as intended, 
analyses based on attendance. 

o 9 
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Five crojecc Evaluation Criteria were investigated, tnree regarding 
achievement data (CTBS) aud one each regarding Employment Skills (ES) and 
Client Retentxon. 

CTBS: 

1. Clients who attend 75% of the program days will demonstrate gain of at 
least one (1) grade eauivalent from pretest to posttzest in at least one 
of these areas: reading comprehension, language mechanics, nathematics 
computation* 

2. On average, clients who attend 75% of the program days v;ill improve 
objective-level mastery by 30% from pretest to posttest across 
instructional objectives in respective currici:la. 

3. Contrasted to those who do not, clients who attend at least 75% of the 
program days will attain ob j e c t i v e -1 e ve 1 mastery at a 
statisticaHy-signif icant point, pretest to posttest. 

Employnent Skills: 

1. Of clients who attend at least 75% of the program days, 30^ or nore will 
score 70% or higher on the posttest. 

Client Retention: 

I. At least ^0% of the clients pretested into the program will rttend 75% 
of the program days. 

One hundred sixty-one prospective clients were pretei^ted with the CTBS. 
One hundred twenty-three ES pretest forms wert administered. Ninety-two CTBS 
posttest forms and 94 ES pcsttest forns were administered. Democraph^'c and 
attendance data were recorded on revised PCF forms for all youth pre:ested with 
the CTBS. File folder reports for all 161 youch were computer-i^enerated by the 
Department of Program Evaluation. These reports were customized Co include 
demographic/attendance data and the results of each test taken Hy the pupil, 
even though a pupil might not have been determined eligible for service. 

Achievement data were scanned and scoreu using TESTMATE conputor software. 
Employment skills data were scanned and scored using SCANTOOLS computer 
software. Denopraphic and attendance data were encoded Hy this consultant. 
Preliminary reports to program administration were provided each time new data 
were added to the datasets. These analyses were conducted asinr "^^M PS/2 
Model 80. This hardware and SPSS/PC+ were used lo analyze both ^TBS and ES 
data. In terms of grade-equivalent change. 

At CTBS pretesting, 69 (A3%) were female and ^2 ( /7:0 wero nale. Regarding 
ethnicity, 12 (10%) were non-minority, 102 (83%) black, one (TO Spanish 
surname,' and eight (7%) were Asian (only 123 forms included ethnic-group 
identification)-) 

At CTBS posttesting. Including the 75% attendance requirement f?0 out of 39 
days), the sex ratio changed markedly. Ziighty-three clients attended at^ least 
30 days of instruction. Females (Al, A9%) about equaled nales (42, 51%); 28 
females did not meet the attendance criterion while 50 males attended less than 
39 days of instruction* 

ERIC 
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Clients were enrolled into one of two programs: reading comprehension, 
language mechanics. The 123 enrolled clients were split 85 into the reading 
comprehension program and 38 into the language mechanics program. 

Major Findings 

The 123 clients <*ntotcd into programs were diverse regarding sex, race, and 
ability. Forty-two percent (52) were female, 58% (71) were male. Eiphty-three 
percent (102) vere black. Twelve were non-minority; one Spanish surname, eight 
Asian. Thirty-eight percent (47) were black females and 452 (55) were black 
males . 

At posttesting, 83 clients met the 30 day criterion: 41 (49%) female and 42 
(51%) male. Sc nty black clients remained: 37 (43%) female and 33 (40%) male. 

Forty clients in the 1990 Summer Program did not meet the attendance 
criterion: 11 (27.57) female and 29 (72.5%) male. About 25% of this group was 
black/female (10); about "^5% was black/-.ale ^22). 

Based on CTBS pretest scores, ^6 of thesti U3 clients were classified into 
a group called "Lowest Pretest Achievement" (LPA). These clients scored at 
about the 4.0 GE point on Reading Comprehension. Of these 45 clients, 32 were 
retained (attended 30 or more days of instruction). That is, of the 83 total 
clients carried forward to the analysis stage, almost 39% of the evaluation 
sample was LPA. A documented comparison statistic from 1989 is net nvailable; 
the Program Coordinator reported to the program evaluation consultant that 
there were at least twice as many LPA clients this year as in 1989. For this 
reason, certain data analyses reported below were partitioned into "Ref^ular" 
and "LPA" subsets to clariiy the "change" or "gain" values observed. 

Achievement Te s ting Results (CTBS) 

CTBS evaluation Question : 

Clients who .ittena 75% of the program days will derronstrate \ 
gain of It least one ( 1 ) grade ».^quivalent from pretest tn 
post test in at least one of these .Jreas: reading crmprehension , 
language mechanics, mathematics computation. 

To be included In this analysis, a client attended 30 days of instruction. 
Of Che 83 clients who met this requirement, -8 (5S%) gained at least one GE in 
at least one of the three possible areao. And, these 48 clients actually met 
the GE criterion (at least 1.0) 68 times: --pading comprehension 26, language 
mechanics 22, mathematics computation 20. Average grade-equivalent gain was 
+0.6 for reading comprehension, +0.6 for langnige mechanics, and +^.2 for 
mathemntics computation. The criterion fot this evaluation question was not 
^ichieved. 
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In contrast, clients attending less than 30 days , rarely met the criterion. 
Only three clients gained at least 1*^ in reading comprehension, one in 
language mechanics, and '* ^^e in mathematics computation. Moreover, in each 
Instance the client ntteuccd between 26-28 days of instruction. Tables 1-6 
present data for pupils tested who attended at least 30 days of instruction. 

The Wide Range Achievement Test (WRAT R2), was ndminiscered the two LPA 
classes. Since the CTBS measures from grade equivalent four, the VHIAT R2, 
vhich measures fron grade «*quivalent three was used to obtain a progress 
measure for the lowest achievement levels. A pre-post URAT R2 test comparison 
involving 35 students showed that 30 students netted a gain of at least a 0.5 
..;^rade level in either reading, spelling or arithmetic. Sixteen students 
achieved a 0.5 grade level advancement in at least two '^f the three above 
nentioned areas. Twenty-six students at this level achieved grade level 
advances of 1.0 to 6.O.* 

CTBS Evaluation Quastion ; 

On average, clients who attend 7 5% Oi. tne program days will 
improve objective level mastery by 30% from pretest to posttest 
across inf^t ructional objectives in respective curricula. 

Data for this evaluation question are summarized as Table 7. Note that 
this table is pot directly comparable to Table 1 in the 1989 report; uhe 1989 
rabl- included all clients either/both pre- and posttested. TaDle 7 includes 
(>nly clients who met the 50-or-raore-day 5-attendance criterion. 

"Mastery" refers to the proportion of clients who successfully answer 
questiors regarding a particular instructional objective. Scoring of items 
results in assigning to each client, a if the oojective was nasrered, a "P" 

if partially mastered, or a if the objective wab not mastered; Then, 

dividing the number of "mastered" by the uotal respondents for that objective 
/lolds the proportions in Table 7. 

\ client who attended '5/; of the available ictendanco days (30 days 
ninimun) increased the number of instructional objectives mastered 
rpretust-posttest) by y\ Eirhcy-three clients met rbis attendance criterion. 
^>n pretesting of the 16 instructional objectives, the average number mastered 
was 2^%. After rreatnent and posttesting, the average was 29^ r^astered. Over 
the ♦-ight-week remediation interval, clier.ts" mastery of the 16 instructional 
objeotives increased from less than four to between ^ive and six. 

The change increment of 30% — on average — was ^ot reached in 1990. The 
avoraitTe cbanpe observed for 1990 was +5?; i.e., across the !6 achievement 
objectives, tho average was a 5.^ increase from pretest to posttest. 

Uritlng Techniques improved from 22% mastery to 3AT^, representing the 
.:^reatej?t positive change observed. Beginning Work/Titles, ^-^n the other hand, 
decreased from 24% to 20/,, a net loss of 4*' mastery* Fourteen objectives 
improved while two objectives had posttest p^rcents-mastered less than on 
,iretesting. 

^URAT information was provided by the 1990 Summer Prot^.^^^ Coordinator. 
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CTBS Evaluation Question : 

Contrasted to those who do not, clients who attend at least 75% 
of the program days will attain objective-level mastery at a 
statistically significant point, pretest to posttest. 

Table 8 presents the contrast (to Table 7) group. Clients included in 
Table 8 attended less than the required 30 days of instruction needed to meet 
the 75% attendance criterion. Note that 27 of the 40 clients in this 
attendance group did not take the CTBS posttest. Thus, only 13 clients 
actually are included in Table 8. The 13 clients who did take the posttest 
averaged more than 20 days of attendance. Results from such low-frequency 
analysis are to be intarpreted with care* 

The intent was to evaluate "mastery change" for two groups: <30 days 
attendance (A), >^30 days attendance (B). The null hypothesis was that the 
;>roportion attaining mastery at posttest time for A would be lower (significant 
at the 0.05 level) than that for B. That is, for example, given 10 in each 
group at pretest with no mastery in either group, at posttest A i?ight have 2 
mastery while B would have _6. Underlying the evaluation question is the 
assumption that one would be unlikely to attain mastery of any objective 
without attending instructional sessions. Or, the more sessions attended the 
more likely that posttest mastery could be realized. 

However, after careful consideration of posttest data foi the <30 days 
group, use of this information for statistical purpose? was rejected. The 
reason for rejection was the small number (13) of cli. .rs who completed the 
posttest. Preliminary non-parametric tests using this roup contrasted with 
the >30 day group produced data of questionable stability. Thus, use of this 
group" for further analysis did not appear to be productive. 

iherefore, attention was given to the 83 clients who attended 30 or more 
days of instruction. Tables 9-2A display analysis ii-/ormation for each of the 
16' instructional objectives. These tables are in the same objective order as 
aie Tables 7 and 8. "RCl" is the descriptor fo- Readin?^ Comprehension, 
Objective 1 (Passage Details)-pretest . "PRCl" is the descriptor for the same 
objective-pos ttes t . 

Col uraiis/ rows labeled "+" indicate mastery. So, using Table 9, 16 clients 
mastered Passage Details on both the pretest and the posttest. Twelve clients 
who did not master this objective on the pretest did master it at posttest. On 
the other hand, eight clients who mastered Passage Details on pretest failed to 
obtain nastery on posttest. Thei.fore, a net gain of four <-lients was 
realized. A summary of these data .s reported as Table 25. Clearly, regarding 
improved mastery counts, the major achievement gains were in the areas of 
Writing Techniques, Quotation Marks and Adds Decimals or Fractions. 

But, consider Tables 26 and 27. Here, data from Table 25 is spli* to shew 
the effect of the LPA group (N=32) on "change" in Table 25. Clearly, any 
report of nastery using Table 25 data for this Evaluation Question is seriously 
biased by the LPA effect. That is, most change reported in Table 25 is 
attributable to the non-LPA group. JIastery, as a concept, is not a food change 
indicator for the LPA group. 
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ES Evaluation Question : 

Of clients who attend at least 75% of the program days, 80% or 
more will score 70% or higher on the posttest. 

Tables 26-29 summarize Employment Skills (ES) pre/posttest . Tables 26 and 

27 report distributions for all clients taking the test, if accepted into the 

program. fables 28 and 29 report ES pre- and posttest values. Tables 26 and 

27 are for all 123 students entered into a program; Tables 28 and 29 are for 
clients in the program who attended at ieast 30 program days. 

To meet the criterion a client had to score a 38 or more on the ES 
posttest. From Table 29 it can be observed that 61 clients net or exceeded 
this value on posttesting, among those who attended 30 or more days of 
instruction. This number~61~represents 73% of the 83 possible. Thus, the 
criterion for t* 's evaluation question was not achieved. The average pretest 
and posttest scores for clients who met the attendance criterion were 32.9 and 
40.3 respectively. 

Compare Tables 27 and 29. Note that the full range of scores represented 
by the 123 clients in Table 27 also appears in Table 29. That is, there does 
not seem to be the same attenaance factor operating with ES as was observed for 
CTBS. 

Client Retention Evaluation Question : 

At least 90% of "he clients pretested into the program will 
attend 75% of the program days. 

Of the 123 clients pretested into one Oi. the two instructional programs, AO 
(38%) failed to attend the minimum of 30 or more days attendance). About ill 
clients would have to have been reta-»\ied to meet the criterion. 

Although the 90% level was not reached during the 1990 Summer Program, 
achievement results arc similar to those observed in 1^89, Taken as a whole, 
recognizing that it was not possible—in 1989 — to evaluate achievement with 
respect to attendance, 1990 grade-equivalent "gain" does not seem appreciably 
at variance with observations from 1989. However, the 90% criterion se^jras 
worthwhile to retain for use in 1991. As a goal to strive for, this 
criterion—if attained— would indicate that most of the clients accepted into 
the program have a good chance of realizing success regarding the achievement 
criterion. 



Summary/Recommendations 



The 1990 Summer Program in several ways replicated findings similar to 
those reported in 1989. Clearly, achievement progress during the eight-week 
instructional period is dependent Ko a large extent on attendance. Clients 
whose attendance is less than the 75% criterion are unlikely to succeed (have 
at least one GE gain of 1.0 or more). Althougn, it is not unusual for clients 
who attend more than just a few days to demonstrate "gain" on one or more of 
the measurements; a gain of l.O or more for clients attending less than 30 days 
is rare. 
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Tv7enty clients met the GE criterion on mathematics computatici. Since no 
specific program of this type was offered during the 1990 Summer Program, it is 
reasonable to suggest that trauofer of reading skills may have played a role in 
this regard* Or, positive gain may be due to an improved attitude toward 
knowledge acquisition in general. 

The picture is not so clear regarding Employment Skills improvement. While 
"gain" was observed, the relationship with attendance was by no means as 
remarkable as that between attendance and achievement gain. This evaluation 
issue did not reach the 80% level but 73% of the clients did score above the 
criterion level. 

It is important to clarify the evaluation philosophy/methodology to be 
followed for analysis of the 1991 Summer Program. Clarification is needed to 
avoid the Lowest Achievement Group (LPA) problem identified this year. That 
is, about four of every 10 clients in 1990 were LPA clients. Assessment in 
terms of norm-referenced testing of LPA clients (a) is not recommended and (b) 
insures that evaluation criteria stated with non-LPA clients in mind probably 
will fail to revea- programmatic gain. Two groups, LPA and Pee'-iar, should he 
analyzed, using evaxaation criteria writcen for and appropriate to respective 
groups . 

Client retention did not meet the criterion. This is an ^nportant factor 
in achievement gain and increased emphasis should be given to promoting the 
retention factor. For those retained in the program, achievement results were 
impressive. Exactly what percent represents a realistic retention level is yet 
to be determined. Comparison with similar Summer Programs elsewhere should be 
used to assess the 90% value used for the ptesent program's evaluation. 

Client retention is weakest for male/black clients. Of the 102 blacks 
enrolleo, 47 were female and 55 were male. At posttest time, adding in the 
30-day retention factor, 70 black clients remained, 37 female and 33 male. 
That is, female/black retention was 79% and male/black retention was 60%, among 
blacks pretexted into either reading comprehension or language mechanics ♦ 

Participation in the 1990 Summer Program was heavily weighted toward black 
clients. Only 12 non-minority clients were pretested/enroll ed into a program; 
i.e., less than l'^: of all enrolled clients were non-minorities* Additional 
effort should be made to recruit non-minority clients for the 1991 Summer 
Program* This recruitment effort would aid the project in serving its target 
population, i.e., all economically disadvantaged JTPA eligible clients 
interested in project services. 

Observing achievement change with respect Lo attendance patterns is 
fruitful. It is recommended that subsequent assessments of PIC Summer Programs 
focus on this issue, that client retention be afforded additional empharis, 
particularly regarding male/black clients. It is well understood that 
predictable learning can and does take plaoe for clients who attend nost of the 
total instructional days available. 
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Table 1 



Pretest ^<>ading Comprehension 
Clients Attending 30 or More Days 
Grades-Equivalent Distribution 
1990 PIC Summer Program 



G.E. 

Value Frequency 



4.0 


16 


4.3 


A 


4.7 


3 


4,9 


6 


5.0 


1 


5.2 


2 


5.3 


2 


5.4 


2 


5.6 


3 


5.7 




6.0 


2 


6.2 


4 


6.5 


5 


6.9 


1 


7.3 


& 


7.7 


1 


8.1 


3 


8.3 


4 


8.5 


1 


8.7 


2 


8.9 


2 


9.1 


2 


9.3 


1 


9.6 


1 


9.9 


3 


10.5 


2 


12.9 


3 




1 



Cumulative 
Percent Percent 



19.5 


19.5 


4.9 


24.4 


3.7 


28.0 


7.3 


35.4 


1.2 


36.6 


2.4 


39.0 


2.4 


41.5 


2.4 


43.9 


3.7 


47.6 


2.4 


50.0 


2.4 


52.4 


4.9 


d7 . J 


6.1 


63.4 


1.2 


64.6 


4.9 


69.5 


1.2 


70.7 


3.7 


74.4 


4.9 


79.3 


1.2 


80.5 


2-4 


82.9 


2.4 


85.4 


2.4 


87.8 


1.2 


89.0 


1.2 


90.2 


3.7 


93.9 


2.4 


96.3 


3.7 


100.0 


Missing 





Total 83 100.0 
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Table 2 



Posttest Reading Comprehension 
Clients Attending 30 o: More Days 
Grade-Equivalent Distribution 
1990 PIC Summer Program 



G.E, 






Cumulative 


Value 


Frequency 


Percent 


Parcent 


4.0 


13 


1 S . 9 


1 J .9 


4.3 


5 


6.1 




4.6 


2 


Z.4 




4.9 


2 




2o .0 


5.0 


1 




Zo.O 


5.2 


7 


o c 
O- J 




5.3 


1 


i O 
I . 1^ 


J/ . O 


5.4 


2 




40 . 2 


5.6 


3 


3.7 


4 J .9 


5.7 


2 


2.4 


4o . J 


5.8 


2 


2.4 


4o.o 


6.0 


1 


1.2 


50.0 


6.2 


1 


le2 


51 .2 


6.5 


1 


1.2 


52.4 


3.9 


7 


3.5 


61.0 


7, 


1 


1.2 


62.2 


8.1 


9 


2.4 


64.6 


8.3 


3 


3.7 


68.3 


8.5 


1 


1.2 


69.5 


8.7 


3 


3.7 


73.2 


8.9 


3 


^1 7 


7 A ft 
/ 0 . 0 


9.1 


I 


1.2 


78.0 


9.3 


3 


3.7 


81.7 


9.6 


3 


3,7 


85 4 


9.9 


4 


4.9 


90.2 


10.5 


I 


1.2 


91.5 


12.2 


I 


1.2 


92.7 


12.9 


6 


7.3 


100.0 


• 


1 


MISSING 




Total 


83 


100.0 
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Table 3 



Pretest Language Mechanics 
Clients Attending 30 or More Days 
Grade-Equivalent Distribu^-ion 
1990 PIC Summer Program 









L> umu X a L 1 V e 


Value 


r requency 


rercenc 


Percent 


H • u 




JO • J 


38. 2 


A 1 
H • J 








A ^ 


9 




46.9 


A P 


s 

J 


o • ^ 


53. 1 


J7 • U 






56.8 


J m O 


A 


4.9 


61.7 


5.6 


3 


3.7 


65.4 


^ 1 




6. 2 


71.6 


6.7 


5 


6.2 


77.8 


7.3 


3 


3.7 


81.5 


7.9 


2 


2.5 


84.0 


8.4 


1 


1.2 


85.2 


9.0 


1 


1.2 


86.4 


9.5 


4 


4.9 


91.4 


10. 1 


1 


1.2 


92.6 


10.8 


2 


2.5 


95.1 


11.8 


1 


1.2 


96.3 


12.9 


3 


3.7 


100.0 


• 


2 


MISSING 




Total 


83 


100.0 
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Table A 



Posccesc Language Mechanics 
Clients Attending 30 or More Days 
Grade-Equivalent Distribution 
1990 PIC Summer Program 



14 



G.E. 

Value 



Frequency 



Percent 



Cumulative 
Percent 



4.0 
4.3 
4.5 
4.8 
5.0 
5.3 
5.6 
6.1 
6.7 
7.3 
7.9 
9.0 
9.5 
10.1 
10.8 
11.8 
12.9 



26 
6 
1 
5 
4 
4 
2 
7 
4 
3 
2 
2 
4 
2 
4 
3 
3 
1 



31.7 
7.3 
1.2 
6.1 
4.9 
4.9 
2.4 
8.5 
4.9 
3.7 
2.4 
2.4 
4.9 
2.4 
4.9 
3.7 
3.7 
MISSING 



31.7 

39.0 

40.2 

46.3 

51.2 

56.1 

58.5 

67.1 

72.0 

75.6 

78.0 

80.5 

85.4 

87.8 

92.7 

96.3 

no.o 



Total 



83 



100.0 



1.9 
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Table 5 



Pretest: Mathemacics CompucaCion 
Clients ^.-cending 30 or More Days 
Grade-Equivalent Distribution 
1990 PIC Summer Program 



G.E. 

Value Frequency 



4.3 


7 


4.6 


8 


5.0 


3 


5.4 


7 


5.8 


3 


6.1 


4 


6.4 


5 


6.6 


7 


6.8 


5 


7.0 


I 


7.2 


I 


7.3 


6 


7.4 


I 


7.5 


2 


7.7 


1 


8.0 


I 


8.1 


2 


8.2 


I 


8.3 


4 


8.5 


2 


8.7 


3 


8.9 


2 


10.3 


-> 


11.1 


I 


11.7 





Cumulative 
Percent Percent 



8.6 


8.6 


9.9 


18.5 


3.7 


22.2 


8.6 


30.9 


3.7 


34.6 


4.9 


39.5 


6.2 


45.7 


8.6 


b'4.3 


6.2 


bO.5 


1.2 


61.7 


1.2 


65.0 


7o4 


70.4 


1.2 


71.6 


2.5 


74.1 


1.2 


75.3 


1.2 


76.5 


2.5 


79.0 


1.2 


80.2 


4.9 


85.2 


2.5 


87.7 


3.7 


91.4 


2.5 


93.8 


2.5 


96.3 


1.2 


97.5 


2.5 


100. 0 


MISSING 





Total 83 100.0 
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Tab? a 6 



Posctest Mathematics Computation 
Clients Attending 30 or More Days 
Grade-Equivalent Distribution 
1990 PIC Surcmer Program 



G.E. 






111 mi 1 1 


Value 


Frequency 


Percent 


T"0 on ^ 


4.3 


13 


1 7 


1 5 7 


4.6 


4 


^ • o 




5.0 


A 

H 


H • O 


25»3 


5.4 


1 
I 


1 0 


96 S 


5.8 


1 


1 9 


97 7 


6.1 


5 


A n 
0 • u 


7 


6.4 


6 


7 0 




6.6 


6 


7 O 


9 


7.0 


2 


z . ^ 




7.2 


A 


4 • o 


SS 4 


7.3 


2 




S7 8 


7.4 


6 




<iS 1 


7.5 


2 


2 • 4 


u / . J 


7.7 


I 


1*2 


Aft 7 
DO. / 


7.8 


I 


1.2 


69.9 


8.0 


2 


o / 

2 . 4 


7 0 1 


8.1 


1 


i.2 


73.5 


8.2 


5 


6.0 


79.5 


O.J 


4 


A. 8 


84. 3 


8.7 


3 


3.6 


88.0 


8.9 


2 


2. A 


90.4 


9.3 


I 


1.2 


91.6 


9.6 


I 


1.2 


92.8 


10.3 


I 


1.2 


94.0 


II. I 


I 


1.2 


95.2 


II. 7 


3 


3.6 


98.8 


12.5 


I 


1.2 


100. 0 


Total 


83 


100.0 
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Table 7 



Percent of Objectives Mastered 
Attended 30 or More Days 
CTBS Form U, Level H 
1990 PIC Summer Program 



Content Area 



Reading 



Test/Obiective 



Percent Mastered 
Pretest Posttest Change 



.ancuaee 



".achenatics 



Comprehension 

Paesage Details 
Character Analysis 
Main Idea 
Generalizations 
Written Forms 
Writing Techniques 

subtest Average 

Mechanics 

Pronoun/Noun /Adjectives 
Beginning Words/Titles 
Period/Question Mark 

Exclamation Poir.t/Comma 
Quotation Marks 
Editing Skills 

Subtest Average 

Computation 

Adds Decimals or Fractions 
Subtracts Decir,' is or 

Fractions 
Multiply Decimals or 

Fractions 
Divide Decimals or 

Fractions 
Integers 

Subtest Average 



Total Test Average 



N 



29 
33 
39 
A6 
18 
22 

22 



33 
2A 
7 

31 
26 

2A 



25 
10 
4 
21 
16 



33 



35 
39 
AO 
48 
24 
34 

37 



33 
20 
11 



44 
34 

29 



31 

25 

15 
6 

18 
19 



29 
83 



6 
6 
I 
2 

6 
12 



5 
-A 
4 

13 

3 



10 



-3 
3 
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Table 8 



Percent of Objectives Mastered 
Attended Less Than 30 Days, Both Pretest and Posttest 
CTBS Form U, Level H 
1990 PIC Summer Program 



Content Area 



Reading 



Language 



Mathen>atics 



Test/Objective 



Percent Mastered 
Pretest Posttest CI 



Comprehension 

Passage Details 
Character Analysis 
Main Idea 
Generalizations 
Written Forms 
Writing Techniques 

Subtest Average 

Mechanics 

Pronoun/Noun/Adjectives 

Beginning Words/Titles 
Period/Question Mark 

Exclamation Point/Comma 
Quotation Mairks 
Editing Skills 

Subtest Average 

Computation 

Adds Decimals or Fractions 
Subtracts Decimals or 

Fractions 
Multiply Decimals or 

Fractions 
Divide Decimals or 

Fractions 
Integers 

Subtest Average 



8 


39 


SI 


31 


23 


-8 


31 


69 


38 


39 


CO 
07 


7n 
ju 


0 


8 


8 


1 5 




u 


21 


37 


17 


31 


39 


8 


23 


8 


-15 


15 


15 


0 


23 


31 


8 


23 


23 


0 


23 


23 


0 


3 


23 


'5 


3 


15 


7 



15 
8 
15 
11 



Total Test Average 



18 
13 



15 
0 
0 

11 



25 
13 



0 
-8 

-15 
0 



*Since these 13 clients— for the most part— did attend nearly as many 
days of Instruction as did the 83 clients represented in "^able 7, it is not 
surprising that these posttest percent -mastery values are what they are. 
Moreover, given only 13 respondents here, these data should be interpreted 
knowingly; a group of 80-100 respondents might or might not appear similar 
regarding posttest scores. 
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obiuciivt: M.i5.icry-Chanp2 Summdty 

LlifefiLi> Who Attended at Least 30 Oayi. 

TAUl L OF RCl BY PRC! 

Kt UJMt^idqr* details (preiest)) 

PKCKPesScige Details (posLtet.i)) 



lii:56 Wednesday, October 3K 1990 58 



1 r i*<jm?iic> 1 








Percent 1 








Row Pet 1 




10 




Col Pet 1 




1 


4 1 


16 


1 


6 1 




19.75 


1 9. 


88 1 




66.67 


1 33. 


33 1 




57.1*4 


1 15. 


09 1 


0 1 


12 


1 


»45 1 




Vi.81 


1 55 


56 1 




21.05 


1 78 


.95 1 




ll2.86 


1 QU 


.91 1 


Total 


28 


65 


53 


311.57 


.1)3 


\ 1 eqiiency 


Missing 


- 2 





Total 
29.63 



5/ 
70.37 



81 

100.00 



biAns>ncs \uH TADiL or rci by prci 



Chi -Square 
LiKellhood Ratio Chi-Square 
Continuity Adj. Chi -Square 
Hantel-Hsenszel Chi-Square 
Fisher's Exact lest (Left) 
(Htght) 
(2-Tal I) 

Phi Coefficient 
Contlnqency Coefficient 
Cramer^s V 



15.536 
15.223 
13.585 
15.3HH 



0.M38 
0.M01 
0.M38 



effective bump I u Si^e 
"requoftcy Missing - 2 



81 



0.000 
0.000 
0.000 
0.000 
1 .000 
1.33C-0U 
2.'i2E-0M 



P* 

for 



24 



KO 



PRir 



ivvu I'll. Suhmef Pronr aiii 

I will. AiteiuliHl Jl least id Hays. 

J Am I Of HC2 BY PRCS 

ht^Jluiji di ler Analysis {pretcsLp ,,..,,11 
PRCLMCharactcr Analysis (i/osttcsin 

f roqiiency I 
Percent I 

Row pet I ^ J 
Co Pet li 10 i 

23.16 I 9.88 I 
1 70.37 I 
I 59.38 I 16.33 I 



n " I 13 I '♦^ i 

^ I 10.05 I 1^0.62 I 66.67 



1 2m!o7 I 75.93 1 
1 140.63 I 83.67 I 
_ _ ^ 4 

39.51 60.59 lOO.Sl 

Mcquency Missing - 2 S 



blAllbllCb iOH lABLE OF RC2 BY PRC2 

, , , Of value Prob 

Statistic 

^^^^ 0.000 

Chi-Square { {JJ ^71 0.000 

Likelihood Ratio Ct.i-Square 6.271 u 

Contlnuiry Adj. uh.-Square 1^.26 

Mantel-Haenszol Clu Square 1 15.9<IM tj.uuu 

Fisher's Exact let^t LeJ^J;) /./2E-05 

(uigni] Q lAF-ns 

(2.Tall} ^ . 9.l5t or) 

contingency Coefficient ^'IJUg 

Effective baiHpIc Size - 81 
Frequency Hissing = 2 



cr 

— i 

ID 



O 



ro 
o 




19yo PIC Summer Program 
ill. n'i 1 1 - t nastery-Chango Summ.ii y 
wiu Aiiuiuluo ill ii 
i/.iji i ut Hi 3 PHC i 

percent 5 

col PCt l-r J5!__._..| 

21 I n I ^2 

2^.93 1 13.58 ) 39-51 
1 65-63 1 3*^.38 \ 
' 63. 6H I 22.92^1 

o""""""l "^"irl 37 I ^9 
I 61 1 'It*. 68 1 60.*^9 
1 2«4.i:9 1 75.51 I 
I 36.36 1 77.08 1 
„»4 < 

^^"^""^ I1U.7J i>9.26 IUU.06 

I ii,qiiuncy Missing - 2 

blAllt^ncb fOK 1ABl£ of RC3 BY PRC3 
Statistic ?L-.-™™- 

Chi -Square | i^'7fi0 

LiKei^hood Ratio Chi-Square 13. /60 

Continuity Adj. Chi-Square 1 1.91/ 

Hantei-Haenszc ' Chl-Square 1 13. '^oo 
Fisner's Exact mui (Left) 
(Right) 
2-Tull) 

Phi '.oef 1 luiufii n'^lio 

ConLinqency Coeffn-iera "-^'^ 

Cramer^s V ^-^^"^ 

II feci I vc baiMile htZa - 61 
Frequency Hissing - 2 



lii:f8 Wcdncscsy, October 



Prob 



0.000 
0.000 
0.001 
0.000 
1.000 
^ Ol£-0l| 
!4.28£-OI| 



2B 



1991< <*1C Summer Pronram 

It;. 1 1 ve Mastery-Change Summary 

umr.f. WIK, Attended at Least 30 Oayi- 

TABl E OP RCli BY PRC'l 

KC'iCOeneralizations (pretest)) . 

PRCHlGeneralizations (posttest)) 

\ reqnericy j 
Percent 
Rov Pet 
Col Pet 



li»:58 Wednesday, October 



0 



10 



28 1 

31*. 57 I 

73.68 I 

71.79 I 



n I 

13.58 I 

25.58 I 

28.21 I 



39 
ii8.15 



Total 

Iruqnency Hissing - 2 



I 

10 I 
12.35 I 
25.32 1 

23.81 1 
+ 

32 1 
39.51 I 
7t4.U2 1 

76.19 1 
+ 

U2 

51.85 



Total 

38 
i»b.91 



i43 

53.09 



81 

100.00 



blAMSIICb I OK lABlE or RCU BY PRCU 

DF Value Prob 
Statistic IZ 



Chi-Square 

Likelihood Ratio Chi-Square 
Continuity Adj. Chi-Square 
Mantel-Haenszel chi-Square 
risher^s Exact le'.l (Left) 
(Right) 
(2-Tai I ) 

Phi Coefricient 
Contlnqency Coefficient 
Cramer^s V 

Effective Sample SiZe - 81 
Frequency Missing - 2 



18.697 
19.*l75 
16.820 
18. U66 



O.U33 
0.U80 



0.000 
0.000 
0.000 
3.000 
1.000 
1.51E-05 
1.92E-05 



nn 



lyyo IMC Summer Program 
in.jtfciivfc KdStery-Cnange Summary 
Ll.ufits. WHO Attended at Least 30 Oayb 
TABl t or RC5 BY PRC5 
KCMWrttten forms (pre te^^^^ 



HI :58 Wednesday. October 31. 1990 62 



f reqiiency 1 

Row Pet 
Col Pet 




10 




+ 


1 13 
1 73 
1 55 


n 1 

58 1 
.33 1 
.00 1 


U.9U 
26.67 
6.56 


0 


1 11 
1 13 
1 15 


9 1 

.n 1 

.61 1 
.00 1 


57 
70.37 
86.36 
93. UU 


Tota 1 


2i\ 


20 


61 
75.31 



Total 

15 
18.52 



66 
81 .U8 



81 

100.00 



frequeney Missing - 2 



STAMSTICS FOR TABLE OF RC5 BY PRC5 

OF Value Prob 
Statistie 



23.U2U 
20.571 
20.32U 
23.135 



0.536 
0.U7U 
0.538 



0.000 
0.000 
0.000 
0.000 
1.000 
1.13E-05 
1.13E-05 



Chi -Square . ^ . 

Likclinood Ratio CHi-Square l 
continuity Adj. Chi-Square 
Mantel-Haenszel chl-Square l 
Fisher's Exaet lest (Left) 

(Right) 

(2-Tail) 

Phi Coefficient 
Contlnqeney Coefficient 
Cramer's V 

Effec'»,ive Sample Size = 81 

Frequency Missing =2 ovnprted counts less 

oAQMiMH* of the ce s have expecteu uuuni^o 

WARNING. ^Square may not be a valid tes^ 
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lii:58 Wednesday, October 31 . 1990 63 

1990 IMC Summer Program 
Oi.ju'cuve MHStery-Change Siirmiary 
(.liinis. Wlio AiLendt»d at I eabt 3u Hays. 
[Abl L OF RC6 BY ?VxC6 



It o(wi I Li»»a Techniques (pretest)) 

PHC6(Writin9 Techniques (positest)) 



Frequency! 
Percent 1 



Row Pet I , Total 

Col Pet U 10 



I 15 I 3 1 18 

I 18.52 I 3.70 I 22.22 

I 8?. 33 I 16.67 

I 53.57 I 5.66 | 

n 13 I 50 I 63 
^ 16.05 I 61.73 I 77.78 

I 20.63 I 79.37 

I ^6.^z I 9^,34 I 

I + + 

3^.57 65.5! 100. §0 
frequency Hissing =2 

SIATISTICS FOR TABLE OF RC6 BY PRC6 » 

DF Value Prob 

Statistic 

- 24 332 0.000 

Chi -Square , ^ 1 oii'nft? 0.000 

Likelihood Ratio Chi-Square 24.082 ^^^^^ 

continuity Adj. Chi-Square 2i.b.^y ^^^^ 

Hantel-Hsenszel Chi -Square 1 ^'^•o^s^ ^ 

Fisher's Exact lest Left) 2.01E-06 

1"-'"'" 0 

Phi Coeff icient 

Continqency Coefficient ^-^^^^ 
Cramer^s V 

Effective Sample Size - 81 
Frequency Missing = 2 



(D 

4^ 



1990 IMC Summer Program 
oujuciive Mastery-Change Summary 
Ciii-mt. W^u) Attended at Least 30 Days 
[ABI L OF I HI BY PLMl 
tHMPronoun/Noun/A^^^^^ (posttest)) 
F reqnency I 



lii:58 Wedi jsday, October 



percent 
Row Pet 
Col Pet 



10 



+- 

22 1 
27.50 I 
81. U8 1 
70.97 I 



9 I 
n.25 I 
16.98 I 
29.03 1 



lotal 



31 
38.75 



I 

+ 

5 I 
6.25 I 
18.52 I 

10.20 I 


MM 1 
55.00 I 
83.02 1 
89.80 1 
+ 

M9 
61.25 



lotal 

27 
33 75 



53 
66.25 



80 

100.00 



Irequency Missing = 3 



SIATIbllCS FOR TABLE OF LMl BY PLMl 



Stati St I c 



DF 



Value 



Prob 



Chi-Square . 
Likelihood Ratio Chi-Square 
continuity Adj. Chi -Square 
Mantel-HBenszel Chi -Square 
Fisher's Exact lest (Left) 
(Rl ght) 
(2-Tai I ) 

Phi Coefficient 
Continoency Coefficient 
Cramer 6 V 

Effective Sample Size = 80 
Frequency Missing = 3 



31.35M 
32.652 
23.696 
30.962 



0.626 
0.531 
0.626 



0.000 
0.000 
0.000 
0.000 
1.000 
2.61E-08 
2.61E-08 



30 



1990 PIC Summer Program 

Object I vt: Mastery-Chdnge Summary 

Ciit-iiis. WHO ALiended at teast 30 Days 

TAbl i 0\ LH2 BY PLH2 

I Mii(beiinning Words/Titles (Pr^;^^*^^)) ,nn<:ttesLn 
in^iDcj pi,M2(Beginning Words/Titles (posttesL)) 

\ t iMjiajncy 1 



lii:5& Wednesday, OcLobei 31*, 1990 b'j 



purceni 
Row Pet 
col Pet 



10 



I Total 



10 1 

' .50 I 

5::. 63 I 

62.50 I 



6 1 

/.50 I 

9. 8*4 I 

37.50 I 



16 
20.00 



4 

9 I 
11.25 I 
M7.37 I 
1i<.06 1 
+ 

55 I 
66.75 I 
90.16 I 
85.94 I 
+ 

6M 
80.00 



19 
23.75 



61 
76.25 



80 

IOj.OO 



lota I 

20.00 

\ requeney Missing - 3 

SlAIlbllCS FOR TABLE OF LM2 BY PLM2 



Stat i St I e 



DP value Prob 



16.583 
1U.559 
14.016 
16.376 



0.'i55 
0.414 
0.455 



0.000 
0.000 
0.000 
0.000 
1 .000 
2.08E-04 
2.08E-04 



Chi -Square I 
Likelihood Ratio Chi-Square i 
continuity Adj. Chi -Square i 
Hantel-Haenszel Chi -Square i 
Fisher *s Exaet lest (Left 

(Ri ght) 

(2-Tai I ) 

Phi Coet ficicnt 
Continqeney Coeffieient 
Cramer^s V 

LITeetivc bample Size - 80 

[/AHrNr Sri^'the'eelis have expeeted counts less 
HAKWiNb. n^jb^^ ^ chi-Square may not be a valid test. 



cr 
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1990 PIC Summer Program 

Objective Mastery-Change Snmmary 

CI M ills wn<) At tended at Least 30 Oavi, 

TAB! C OF I M3 BY PLM3 

i HJ(Pcf lOd/QnesMon Mark/C. Point (pretest)) 

PLMB'Period/Question MarK/L. Point (posttest)) 

F requency I 



in:58 Wednesday, October 31, 1990 66 



Percent 
Row Pet 
Col Pet 



I 
I 

1 + 



10 



4 


4- 






^ 1 


6 1 




0 


1 7. 


50 1 


0 


CO 


1 100 


00 1 


0 


00 


1 66 


67 1 


0 


00 


0 1 


3 1 




71 


1 3 


75 1 


88 


.75 


1 U 


05 1 


55 




1 33 


33 1 


'lOO 


.00 


Tota 1 


9 




71 


11 


► 25 




75 


1 requency Mi ss i ng = 


3 




blAl Ibl ICS 1 OR 


Table 


OF 


:.M3 



I Total 
6 

;.!>o 



7ii 
92.50 



80 

100.00 



Statistic 



OF 



Va lue 



51.171 
31.164 
42.013 
50.532 



0.800 
0.6?') 
0.800 



Prob 



cr 



0.000 
0.000 
0.000 
0.000 
1 .000 
2.80E-07 
2.80E-07 



Liti -Square 1 
Likelihood Ratio Chi-Square 1 
continuity Adj. Chi-Square 1 
Mantel-riaensze I Chi-Square 1 
Fisher's Exact lest (Left) 

(Right) 

(2-Tai I) 

Phi Coefficient 
Contingency Coefficient 
Cromer'^s V 

t rective Sample Si^e - 80 
Frequency Missing - 3 

WARNING: 25% of the cells have expected counts less 
than 5. Chi-Square may not be a valid test. 




199t» Summer Program 

()U|i-<i'vt. Mastery-Change Swrnniar y 

t.lMi.u wiiu AU ended at ieai>i 30 Doy: 

IA»U t Of I Mil BY PLHil 

1 Mii(Uuotai lo.i Marks (pretest)) ^,,,,.^,v> 
iniiMiKu p^^j^j^(Q^Q^^^,,^ion Mar-KS (posttest)) 

Frfcqiiencyl 



in :56 Wednesday, October 31, WO 



67 



Percent 
Row Pet 
Col Pet 



10 



lota I 
Frequency Missing 



I 

♦ 

20 I 5 1 
2^).00 I 6.25 
80.00 I 20.00 
55.56 I 11.36 I 
+ + 

16 I 39 I 

20.00 I 

29.09 I 70.91 

\ 88. 6U I 

+ 

36 

i\b.00 55.00 



lota I 

25 
31.^5 



55 
6B.75 



80 

100.00 



bUllbllCb rOK TABLE OF LM«< BY PLMh 



Statistic 



OF 



Va I ue 



Chi -Square 

Likelihood Ratio Chi-Square 
continuity Adj. Chi -Square 
Hantei-Hsenszol Chl-Squore 
FlsherS Exact lest (LeTt) 
(Right) 
(2-Tol I) 

Phi Coefficient 
Cootlnqency Coefl icient 
Cramer^s V 

Efrective Sample Si^e =• 80 
Frequency Missing - 3 



17.998 
18.756 
16.000 
17.773 



0.U7U 
0.U29 
0.U7U 



Prob 



0.000 
0.000 
0.000 
0.000 
1.000 
.iilE-05 
.77E-05 



XX 



00 



03 



33 



\\f<ju Summer Program 

uio^itiv Hastery-Cliange S- mmai > 

umin? wilt Aiicndud at least 3t) Uayi 

I Of I Mt> BV PlMt> 

lM^(Ui tiruj SKI IIS (pretest)) 

Pi M5(Eai • ing Ski I IS (pobtieut)) 



lii:S>8 V/edwUbCay, October il, 1990 



F 1 cqiioncy 1 








Percent 1 








Row Pet 1 


+ |0 






Col Pet 1 




1 




17 1 




*4 1 




21.25 1 


5. 


00 1 




80.95 1 


19. 


05 1 




62.96 I 


7. 


55 1 










0 1 


10 1 




ii9 1 




ia.$o 1 


61 


.25 1 




16.95 1 


83 


.05 1 




37.04 1 


92 


.M5 1 








Total 


27 


66 


53 


33.75 


.25 


t rcqiiency 


Ml ssing = 


3 





Tota 1 

21 

26.25 



73.75 



80 

100.00 



blAllbllCS rOH TABLE OF LM5 BY PLHb 



Statistic 



or 



Va lue 



Prol) 



Chi -Square 

LiKelihood Ratio Chi-Square 
Continuity Adj. Chi -Square 
Mantel-Haenszel Chi -Square 



Fiiiher^s Exact lest 



(Left) 
(RIOht) 
(?'Tai I ) 



Phi Coeffitient 
Continqency Coefficient 
Cramer^s V 

Effective bample Size - 80 
Frequency Hissing = 3 



26.374 
26.148 
25.564 
26.020 



0.596 
0.512 
0.596 



0.000 
0.000 
0.000 
0.000 
1.000 
l*.b6E-07 
2.56E-07 



34 



111-58 Wednesday, October 31, 1990 69 

1990 PIC Summer Program 
Objective Mastery-Change Summ^ary 
Client!. v;ho Attend'.d at Least 30 ;>ays 
urn £ OF MCI BY PMCl 

\ rijqnerr.yl 
percen. j 

Row Pet i . , T^,. o I 
CCS Pet U 10 i ^"""^ 
+ + t 

I 18.07 I 2.^1 I iio.ua 

I 88.214 I 

I 57.69 I 3.51 I 

16.67 1 83.33 
1 U2.31 I 96. U9 I 
I + + 

o/: "i? 83 

31.33 68,67 100.00 



SIATISTICS FOR TABLE OF HCl BY PMCl 



Statt'olic 



OF 



Val ue 



Chi -Square , ^ 

Likelihood Ratio Chi-Square 
continuity Adj. Chi -Square 
Mantel-Haenszel Chi-Squore 
Fisher's Exact lest (Left)^ 

(2-Tal I) 

Phi Coefficient 
Contlnoency Coefficient 
Cramer^s V 

Sample Si 2e - 83 



32.186 
31.U09 
28.9U5 
31.798 



0.623 
0.529 
0.623 



prob 



0.000 
0.000 
0.000 
0.000 
1.000 
,20E-08 
.20E-08 



cr 
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J99ti l'>C Summer Program 
oi.jective Mastery-Change Summary 
Ci.onti. Who Attended at Least 30 Days 
lAlil E OF MC2 BY PHC2 

HCSu.. t--- -o^ec?^.air^r'rra^^^ (posctest), 
f reqiiency I 



li,:S»a Wudnesday, octc/jer 3V, 1990 



10 



percent 
Row Pet 
col Pet 



Tota 1 



10 I 

+ t 

16 I 5 
19.28 I 6.02 
76.19 I 23.81 
76.19 I 8-06 I 

--4 ^ 

^1 57 I 

6.02 I 68.67 I 

8.06 I 91. 9U 

23.81 I 91. 9U 1 

+ + 

21 62 

25.30 711.70 



21 
2t>.30 



62 
7U.70 



83 

100-00 



STATISTICS FOR TABLE OF HC2 BY PHC2 

OF Value P^ot) 
Statistte 



uieUhood Ratio Chi;Square 
continuity Adj Ch -Square 
Hantel-Haenszel Chi-Squar^ 
Fisher's Exaet lest ^^^t)^ 

;2-Tall) 

Phi ruefficient 
CorclnQb.'iey Coeffieient 
Cramer^s V 

Sample Size - 83 



38.522 
36.078 
35.001 
38.057 



0.681 
0.563 
0.681 



0.000 
0.000 
0.000 
0.000 
1.000 
^.50E-09 
5.50E-09 



rN5 
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lyVU Slimmer Program 

m. ludivi: Mastery-Change Summary 

i m ux u wild AM ended at l east iU Day^ 

TABl t or MC3 BY PMC3 

Mr wM.iii Dt^rimais or Fr cCtions (pi'Otesi)) 

MU(M..ii. |;;;^^1'^;-i,fi,;cimals or Fractions (posttcst)) 

Frequency I 
Percent 
Row Pet 
Col Pet 



Wednesday, October 3), 1990 7) 



10 



lota I 



I 

3 1 '51 
3.61 I 6.02 
37.50 I 62.50 
25.00 I 7. 04 I 

^ -f 

9 1 66 I 
10. BU I 79.52 I 
12.00 I 88.00 I 
75.00 I 92.96 I 

+ -f 

12 71 

m.n6 b5.5*« 



Tota I 
8 



75 
90.36 



83 

100.00 



STATISTICS FOR TABLt OF MC3 BY PMC3 



Stat i sti c 



DF 



Chi-Square 

Likelihood Ratio Chi-Square 
Continuity Adj. chi -Square 
Mantel-Haenszel Chi-Square 
Fisher's Exact Test (Left) 
(Right) 
|2-Tal I) 

Phi Coefficjont 
Contingency Coefficient 
Cramer's V 



Value 



3.801 
2.965 
2.019 
3.755 



0.21U 
0.209 
0.21U 



Prob 



0.051 
0.085 
0.155 
0.053 
0.987 
0.086 
0.086 



KIng-''25% o? the cells have expected counts less 
HARNiKb. o>^^ ^ chi-Square may not be a valid test. 



cr 



lyyo PIC summer Program 
(jujuciive Mastery-Change Summary 
CiMrnts wtio Attended at Least 3o Oays> 
lAUlL Of HC»l BY PMCM 

roquency I 



lii:5b Wednesday, October 31, 1990 V2 



Percent 
Row Pet 
Col Pet 



Toto I 



+ 10 I ^0^31 
4- -f 

2 1 11 

2.^^ I 1.20 

66.67 I 33.33 I 

40.00 I 1.28 I 

^ V\ 77 I 
3.61 I 92.77 
3.75 I 96,25 
60.00 I 98.72 I 
+ 

5 78 

6.02 93.98 



3 

3.61 



80 
96.39 



83 

100.00 



STATISTICS fOK TABLt OF MCU BY PMCM 



Statistic 



OF 



Value 



20.219 
8.381 
1G.632 
19.975 



0.U9U 
0.MU3 
O.U9i; 



prob 



0.000 
O.OOU 
0.001 
0.000 
1.000 
8.60E-03 
8.60E-03 



Ch' -Square , 
Likelihood Ratio Chi-Square i 
Continuity Adj. Chi-^quare l 
Mantel-Haenszel Chl-Square i 
Fisher's Exact lest ILeft)^ 

(Right) 

|2-Tol I) 

Phi Coefficient 
Contingency Coefficient 
Cramer^E V 

uASNlNf-*^7si If the cells have expected counts less 
WARNING. ^55^^%^^^^^^!^^^^^ may not be a valid test. 



cr 



n> 
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to 



38 



1990 PIC Summer Program 

Objective Mastery-Change Summary 

ciiunts. WHO Attended at Least 30 Days 

TABLt or HC3 BY PHC5 

HCt>(integers (pretest)) 

PMC5( integers (posttcst)) 

t reqiiency 
percent 
Row Pet 
Col Pet 



10 



10 I 

12.05 I 

36.82 I 

66.67 I 



Total 



I 

+ 

7 I 

8.M3 I 

m.18 I 

10.29 I 
+ 

5 1 61 I 
6.02 i 73. 1*9 I 
7.58 I 92.^*2 
33.33 I 89.71 I 
+ + 

15 

18.07 81.93 



Total 

1? 
20. M8 



66 
79.52 



83 

100.00 



lir. 58 Wednesday, October ,n , 1990 il 



STATISTICS FOR TABLE OF HC5 BY PHC5 



Statf stie 



OF 



Va I lie 



23.978 
19.985 
20.6«;2 
23.690 



0.537 
O.U73 
0.53? 



Prob 



0.000 
0.000 
0.000 
0.000 
1.000 
.,50E-05 
K50E-05 



Chi -Square ' 
Likelihood Ratio Chl-Square 1 
Continuity Adj. Chi-Square 1 
Mantel-Haenszel Chl-Square i 
Fisher's Exact lest (Lo^t) 

(Right) 

(2-Tal I) 

Phi Coefficient 
Contlnoency Coefficient 
Cramer^s V 

waSnIwg-'^25X of the cells have expected counts less 
WARNING. 25%^;%^"^|,^!^qua^^ «ay not bo a valid test. 



cr 
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Table 25 



Mastery Change 
Attended 30 or More Days 
1990 PIC Summer Program 



i5 



Content Area 



Reading 



Test/Objective 



Comprehension 

Passage Details 
Character Analysis 
Main Idea 
Generalizations 
Written Forms 
Writing Techniques 



Number Mastered* 
B Change 



12 
13 
12 
11 
9 

13 



8 
d 
11 
10 
4 



4 
5 
1 
1 

5 
10 



Language 



Mechanics 

Pronoun/Noun/Adjectives 9 

Beginning Words/Titles 6 

Period/Question Mark 3 

Exclamation Point/Comm-. 

Quotation Marks 16 

Editing Skills 10 



5 
9 
0 

5 



4 

-3 
3 

11 
6 



Mathematics 



Computation 

Adds Decimals or Fractions 
Subtracts Decimals or 

Fractions 
Multiply Decimals or 

Fractions 
Divide Decimals or 

Flections 
Integers 



11 
5 

9 

3 

5 



2 
5 

5 

1 

7 



9 
0 

4 

2 



*Using those who did not master the objective at pretest but ^id at posttest 
(A) minus those who did at pretest but not at posttest (B). 
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Table 26 



Mastery Change 
Non-Lowest Pretest Achievement Clients 
Attended 30 or More Days 
1990 PIC Summer Program 



Content Area 



Reading 



Test/Objective 



Comprehension 

Passage Details 
Character Analysis 
Main Idea 
Generalizations 
Written Forms 
Writing Techniques 



Number Mastered* 
_A B Change 



11 
10 
9 
9 
9 
11 



7 

6 
9 
8 
3 
2 



4 
A 
0 
1 
6 
9 



Language 



Mechanics 

Pronoun/Noun/Adjectives 6 

Beginning Words /Titles 5 

Period/Question 2ark 2 

Exclamation Point/Comma 

Quotation Marks 1" 

Editing Skills 8 



3 
6 
0 

3 
A 



3 
-I 

2 

10 
A 



Mathematics 



Computation 

Adds Decimals or Fractions 
Subtracts Decimals or 

Fractions 
Multiply Decimals or 

Fractions 
Divide Decimals or 

Fractions 
Integers 



IJ 
A 



2 

3 

A 
I 
6 



8 
1 

A 

2 

-3 



*Using those who did not master the objective at pretest but did at posttest 
(A) minus those who did at pretest but not at posttest (B). 



ERIC 



EVALSRVCS/P548/PICFRPI90 
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Table 27 



Mastery Change 
Lowest Pretest Achievement Clients 
Attended 30 or More Days 
1990 PIC Summer Program 



Content Area 



Test/Objective 



Number Mastered* 
_A B Change 



Reading 



Comprehension 

Passage Details 
Character Analysis 
Main Idea 
Generalizations 
Written Forms 
Writing Techniques 



1 
3 
3 
2 
0 
2 



0 
1 
I 
0 

-1 
1 



Language 



Mechanics 

Pronoun/Noun/Adjectives 

Beginning Words/Titles 
Period/Question 2ark 

Exclamation Point/Comma 
Quotation Marks 
Editing Skills 



3 
1 
1 

3 
2 



2 
3 
0 

2 
0 



Mathematics 



Computation 

Adds Decimals or Fractions 
Subtracts Decimals or 

Fractions 
Multiply Decimals or 

Fractions 
Divide Decimals or 

Fractions 
Integers 



1 
1 

1 

0 

2 



0 
2 

1 

0 

1 



I 

-1 
0 
0 
I 



*Using those who did not master the objective at pretest but did at posttest 
(A) minus those who did at pretest but not at posttest (B). 



ERIC 
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38 



Table 28 



Pretest Employment Skills 
Pupils Entered into a PIC Program 
Raw Score Values 
1990 PIC Summer Program 



Raw 
Score 



Frequency 



Percent 



Cumulative 
Percent 



9 

10 

13 

17 

18 

19 

20 

22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 



2 
1 
1 

2 
1 

2 
1 
1 

3 
I 
4 
6 
1 
5 
6 
2 
A 
9 
4 
5 
8 
8 
9 
11 
8 
6 
3 
2 
4 
1 
2 



1.7 

.8 

.8 
1.7 

.8 
1.7 

.8 

.8 
2.5 

.8 
3.3 
5.0 

.8 
i,A 
5.0 
1.7 
3.3 
7.4 
3.3 
4.1 
6.6 
6.6 
7.4 
9.1 
6.6 
5.0 
2.5 

1.7 
3.3 
.8 

MISSING 



1.7 
2.5 
3.3 
5.0 
5.8 
7.4 
8.3 
9.1 
11.6 
12.4 
15.7 
20.7 
21.5 
25.6 
30.6 
32.2 
35.5 
43.0 
46.3 
50.4 
57.0 
63.6 
71.1 

80. r, 

86.8 
91.7 
94.2 
95.9 
99.2 
100.0 



Total 



123 



100.0 



VALID CASES 121 



MISSING CASES 



ERIC 
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Table 29 



Posttest Employment Skills 
Pupils Entered into a PIC Program 
Raw Score Values 
1990 PIC Summer Program 



Raw 
Score 



Frequency 



Percent 



Cumulative 
Percent 



23 


1 


1 1 
1 • 1 


1 1 


25 


1 


1 • 1 


9 1 
^ . 1 


26 


1 


1 • 1 


J • ^ 


27 


1 


1 1 
1«1 


. J 


28 


1 


!•! 


D.J 


29 


1 


1 • 1 




30 


1 


!• 1 


7 A 


31 


1 


!•! 


O.J 


33 


4 




1 9 51 
1 ^ . O 


34 


2 


2.1 


14.9 


36 


4 


4.3 


19* 1 


37 


5 


5.3 


24.5 


38 


4 


4.3 


28.7 


39 


10 


10.6 


39.4 


40 


4 


4.3 


43.6 


41 


5 


5.3 


48.9 


42 


16 


17.0 


66.0 


43 


3 


3.2 


69.1 


^4 


12 


12.8 


81.9 


45 


4 


4.3 


86.2 


46 


& 


6.4 


92.6 


47 


4 


4.3 


96.8 


48 


/- 


2.1 


98.9 


49 


1 


1.1 


100.0 


• 


29 


MISSING 





Total 



123 



100.0 



VALID CASES 



94 



MISSING CASES 



29 



er|c 



-EVALSRVCS /P548/P ICFRPT90 



44 



40 



Table 30 



Pretest Employment Skills 
Clients Attending 30 or More Days 
Raw Score Valuer 
1990 PIC Summer Program 



Raw 

Score Frequency 



9 


I 


13 


1 


17 


2 


18 


I 


19 


I 


20 


1 


22 


1 


23 


1 


25 


2 


26 


4 


27 


1 


28 


5 


29 


5 


30 


I 


31 


3 


32 


4 


33 


2 


34 


4 


35 


5 


36 


4 


37 


6 


38 


8 


39 


5 


40 


4 


41 


3 


42 


2 


43 


4 


44 


1 


• 


1 



Total 83 



Cumulative 
Percent Percent 



1.2 


1.2 


1.2 


2.4 


l.U 


4.9 


1.2 


6.1 


1.2 


7.3 


1.2 


8.5 


1.2 


9.8 


1.2 


11. C 


2.4 


13.4 


4.9 


18.3 


1.2 


19.5 


6.1 


25.6 


6.1 


31.7 


1.2 


32.9 


3.7 


36.6 


4.9 


41.5 


2.4 


43.9 


4.9 


48.8 


6.1 


54.9 


4.9 


59.8 


7.3 


67.1 


9.8 


76.8 


6.1 


82.9 


4.9 


87.8 


3.7 


91.5 


2.4 


93.9 


4.9 


98.8 


1.2 


100. 0 



MISSING 



100.0 



VALID CASES 82 MISSING CASES I 



^ 45 
ERIC 
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Table 31 



Posttest Employment Skills 
Clients Attending 30 or More Days 
Raw Score Values 
1990 PIC Summer Program 



I aw 






Cumulative 


Score 


Frequency 


Percent 


Percent 


23 


1 


1.2 


1 .2 


25 


1 


1.2 


2.4 


26 


1 


1.2 


3.7 


27 


1 


1.2 


4.9 


28 


1 


1.2 


6.1 


29 


1 


1.2 


7.3 


30 


1 


1.2 


8.5 


31 


1 


1.2 


9.8 


33 


2 


2.4 


12.2 


34 


2 


2.4 


14.6 


36 


4 


4.9 


19.5 


37 


5 


6.1 


25.6 


38 


4 


4.9 


30.5 


39 


6 


7.3 


37.8 


40 


3 


3.7 


41.5 


41 


3 


3.7 


45.1 


42 


13 


15.9 


61.0 


4J 


3 


3.7 


64.6 


44 


12 


14.6 


79.3 


45 


4 


A. 9 


84 . 1 


46 


6 


7.3 


91.5 


47 


4 


4.9 


96.3 


48 


2 


2.4 


98.8 


49 


1 


1.2 


100.0 


• 


1 


MISSING 




Total 


S3 


100.0 




VALID CASES 82 


MISSING CASES 


1 
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